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A novel spin density wave (SDW) instability mechanism enhanced by vortices under fields is 
proposed to explain the high field and low temperature (HL) phase in CeCoIns. In the vortex state 
the strong Pauli effect and the nodal gap conspire to enhance the momentum resolved spectral 
weight exclusively along the nodal direction over the normal value, providing a favorable nesting 
condition for SDW with Q = (2fcj?, 2&f, 0.5) only under high field {H). Observed mysteries of the 
field-induced SDW confined within H C 2 are understood consistently, such facts that Q is directed 
to the nodal direction independent of H, SDW diminishes under tilting field from the ab plane, and 
the SDW transition line in (H,T) has a positive slope. 
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The competing-order phenomena are a hallmark of 
strongly correlated systems. This is particular true for 
superconductors, such as in heavy Fermion materials, 
high T c cuprates or pnictides since competing magnetism 
is deeply rooted to the pairing mechanism itself where an 
SDW order generically competes or coexists with super- 
conductivity (SC)pJ. Thus it is not entirely surprising 
to see that applied field induces an SDW in a supercon- 
ductor. In fact, in Lai_ x Sr x Cu04|2j and CeRhlns under 
pressure^] the field induced SDW is observed only for 
finite fields and is absent at zero field. A remarkable ob- 
servation in CeCoIns is that the induced SDW is confined 
exclusively in the superconducting state below the upper 
critical field H C 2 [3 (see HL in Fig.3(c)). 

Since AbrikosovQ, there have been many studies on 
vortices in a type II superconductor based on a concept 
that the vortex core is a featureless rigid cylindrical ob- 
ject filled with the normal electrons. An emergent new 
concept based on microscopic Bogoliubov-de Gennes or 
quasi-classical Eilenberger framework is recently reveal- 
ing a far richer quasi-particlc (QP) structure both in real 
space and reciprocal space which governs a variety of 
physical characteristics in a type II superconductor un- 
der a field [5). In particular, in a superconductor char- 
acterized by an anisotropic gap, including a nodal gap 
such as a d-wave symmetry, the QP spatial structure is 
directly or indirectly measured by various experimental 
methods, such as scanning tunneling microscope (STM) 
as direct spatial images small angle neutron scattering 
(SANS) as Fourier-transformed imagesQi or field-angle 
resolved specific heat [|| or thermal conductivity Q. With 
this emergent QP concept we would expect to uncover 
new phenomena. 

Here we investigate detailed behaviors of QPs induced 
by vortices with the nodal gap structure (i.e. d x 2_ y 2) and 
the Pauli paramagnetic effect to uncover the origin of the 
HL phase in a heavy fermion superconductor CeCoIns. 
This has been discussed theoretically from different view 
points 13- 14 i . We find generic features of the QP be- 



havior, which enables us to draw vivid physical picture, 
synthesizing the real space and reciprocal space comple- 
mental information. This picture, in particular in recip- 
rocal space, leads naturally us to an SDW instability in a 
high field, which is confined in the superconducting state. 
The duality of the QP behaviors in real and reciprocal 
space is a key concept to uncover the origin of the HL 
phase. Note in passing that in dHvA effect in the super- 
conducting state the QPs executing the cyclotron motion 
in real space carry information in the original Fermi sur- 
face topology in the normal state, evidencing the dual 
nature of the QPs created around the vortex core. 

The mysterious HL phase exists for both H applied to 
the basal plane (#||a&)[ll-[ll] and the c-axis (J?||c)(20t 
of the tetragonal crystal. In particular, for H\\ab case 
the mounting evidence[2l], [22| shows that an SDW char- 
acterizes the HL phase. The HL phase (see Fig. 3(c)) 
appears via a second order phase transition Hq(T) from 
the conventional Abrikosov vortex lattice state. Namely 
the sublattice magnetization of SDW grows continuously 
at Hq(T) and disappears abruptly at H C 2 via a first order 
transition. The ordering wave vector Q — (0.45,0.45,0.5) 
in the reciprocal vector units is independent of the field 
directions F||(110)[I3 and 7J||(100)[22j, and indepen- 
dent of the field strength. The phase boundary Hq(T) 
between the HL and the Abrikosov state is almost inde- 
pendent of two field directions. Hq(T) is an increasing 
function of T. Those features mainly come from the neu- 
tron scattering experiments 2l|, 22 1 and basically are con- 
sistent with other thermodynamic measurements 15j and 
NMR experiments [13, EH- Since the pairing symmetry of 
this material is firmly established as d x 2_ y 2 type[l,0|, the 
origin of this HL phase must be tied to (1) the d-wave 
nature of this system and (2) the vortex state under a 
field. As for (1) the controversy of the pairing symme- 
try either d x 2_ y 2 or d xy is now resolved^ and there 
is little doubt for the d x 2_ y 2 symmetry in CeCoInsQ. 
As for (2) it is known by SANS experiments 0] that the 
Pauli paramagnetic effect is indispensable in understand- 
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ing the anomalous behaviors of the scattering form factor 
as functions of field strength and temperature. The pur- 
pose of this paper is to examine the generic SDW instabil- 
ity enhanced by the presence of vortices under the strong 
paramagnetic effect on the basis of the full selfconsistent 
solutions of microscopic quasi-classical Eilenberger equa- 
tions. 

We calculate the spatial structure of the vortex lattice 
state by quasiclassical Eilenberger theory in the clean 
limit valid for fcp£ 3> 1 (kp is the Fermi wave number 
and £ is the superconducting coherence length) The 
Pauli paramagnetic effects are included through the Zee- 
man term /ZB-B(r), where B(r) is the flux density of the 
internal field and /zb is a renormalized Bohr magneton. 
The quasiclassical Green's functions g(ui n + i/iS,k, r), 
f(u) n + k, r), and P(cv n + i^B, k, r) are calculated 
in the vortex lattice state by the Eilenberger equations 



{w„ + inB + v • (V + iA)} / = Acjig, 
{uj n + ifiB - v • (V - iA)} /t = A*0* 5 , 



(1) 



where g = (1 — ff^) 1 ^ 2 , Reg > 0, v = v/wpo, and the 
Maki parameter \i — iL^,Bojnk^,T c . k = (k a ,kb,k c ) is 
the relative momentum of the Cooper pair, and r is the 
center-of-mass coordinate of the pair. We set the pairing 
function </>(k) = \f2{k"^ — k 2 )/(k 2 + k%) in d x 2_ y 2-w&ve 
pairing. We use the Eilenberger units Ro and Bo [HI- 
The energy E, pair potential A and Matsubara frequency 
toi are in units of i:k^T c . 

The averaged Fermi velocity on the Fermi surface 
Vfo = (v 2 )]/ 2 where (• • -)k indicates the Fermi surface av- 
erage. To model the quasi-two dimensional Fermi surface 
of CeCoIns we use a Fermi surface with warped cylinder- 
shape coming from the so-called a-orbit (see four cylin- 
ders in Fig. 3(a)) [25[ and the Fermi velocity is given by 
v = (v a ,Vb,v c ) oc (cos#fc, sin 6^, v z sin k c ) at the Fermi 
surface k oc (fcFo cos9k, /cfo sin6*fe, k c ) with — ir < 9k < 7r 
and —it < k n < it. We set v z = 0.5, thus the anisotropy 
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ratio 7 = £ c /£ a 6 
CeCoIn 5 . 

As for selfconsistent conditions, the pair potential is 
calculated by 



A(r)= ffo ^oT £ (r(k)(/ + / t> 



0<u„<cj cut 



with (goNo)- 1 = hiT + 2TJ2 



0<w„<w cut u i 



(2) 



We use 



w C ut = 20fcBT c . The vector potential for the internal 
magnetic field is selfconsistently determined by 

V x (V x A) = V x M para (r) - — V (vlm 5 ) k , (3) 

K 

0<uj n 

where we consider both the diamagnetic contribution of 
supercurrent in the last term and the contribution of the 




FIG. 1: (Color online) (a) r-DOS N(r, E = 0)/N in the real 
space where vortex cores are placed on the center of each black 
spot. The view ranges are 16x16 in the Eilenberger unit, (b) 
k-DOS N(k, E = 0) /No on the Fermi surface. Height of the 
upper rings indicates the normal state value, (c) k-DOS is 
resolved into the contributed real space areas of one unit cell 
shown in the inset. Color codes between them coincide. Left 
column for i?||(110) and right for #11(100). H/H c2 = 0.86, 
T/T c = 0.05 and // = 2. 



paramagnetic moment M para (r) = (0, 0, Af para (r)) with 



M para (r) = M 



B(r) 2T 



H 



(4) 



0<LU„ 



The normal state paramagnetic moment Mq = (^t/ k) 2 H , 
k = B /irk-QT c y/8iTNo and No is the density of states 
(DOS) at the Fermi energy in the normal state. We set 
the Ginzburg-Landau parameter k = 89. We solve eq. 
(P} and eqs. ©-(HI) alternately, and obtain selfconsistent 
solutions as in previous works Q under a given unit cell 
of the vortex lattice. 

The local density of states in real space r-DOS is given 
by N(r,E) = 2V t (r, E) + N±(r, E), where N a {r,E) = 
(N a (r,k,E)) k = N (Re{g(uj n +ia/j,B, k,r)\ luJn ^ E+iv }) ]l 
with a = 1 (—1) for up (down) spin component. We typ- 
ically use rj = 0.01. The total DOS is obtained by the 
spatial average of the local DOS as N(E) = N^(E) + 
N^E) = (N(r,E)) r . The spectral weight (SW) distri- 
bution k-DOS in reciprocal space is given by N(k,E) — 
N t (k,E)+N l (k,E) nsN a (k,E) = (N a (r,k,E)) r . Those 
r-DOS and k-DOS are complimentary, giving rise to valu- 
able information for the QP structures in the vortex state 



3 




FIG. 2: (Color online) k-DOS N(k, E = 0)/N for low field 
(upper panel) and high field (lower panel) at k z — 0. (a) 
For #||(110) with Pauli effect n = 2.0 where #/# c2 =0.74 
(upper) and 0.99 (lower), (b) For the absence of Pauli effect 
H — where #/# C 2=0.36 (upper) and 0.86 (lower), (c) For 
#||(001) with fx = 2.0 where #/# c2 =0.77 (upper) and 0.98 
(lower). Height of the upper rings indicates the normal state 
value. T/T c = 0.05. 



as we will see below. 

We show the r-DOS at E = in Fig. 1(a) and the 
corresponding k-DOS in Figs. 1(b) and (c) for #||(110) 
(left column) and if || (100) (right column) for the large 
paramagnetic effect fj, = 2. In Fig. 1(a) we see sev- 
eral characteristic and eminent QP trajectories, notably 
the bands of the zero energy DOS connecting the near- 
est neighbor vortex cores. Those real space trajectories 
correspond to the real space motions of the QP induced 
by H . It is seen that the zero energy r-DOS is depleted 
at the vortex core, and piles up in the surrounding area 
because of the Pauli effect. Due to the Zeeman shift the 
peak of the zero energy DOS at the vortex core moves up 
and down in the energy, resulting in the depletion of the 
zero energy DOS at the core, i.e. the empty core [24| . 
The zero-energy state moves outside from the core where 
its maxima occur. Figure 1(b) shows the correspond- 
ing k-DOS where on the Fermi circle at k z = the SW 
for each k-direction is displayed. The SW enhancement 
along the nodal directions and strong suppression along 
the antinodal directions are clearly seen for both field 
orientations. This comes from the real space area sur- 
rounding the core, which is seen from Fig. 1(c) where 
the contribution to the SW enhancement is resolved in 
the local areas (see inset) with the same areal size. The 
core area (the central region of the inset) gives a minor 
contribution because of the empty core. 

The field evolutions of the k-DOS are shown in Fig. 2(a) 
for #||(110) with the strong Pauli effect. As H increases 
towards # C 2, the k-DOS grows with uneven distribution 
around the Fermi surface, namely the SW is dominated 
along the nodal direction, keeping suppressed along the 
antinodal direction. Upon increasing #, the total DOS 
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FIG. 3: (Color online) (a) Spectral weight distribution drown 
on the Fermi surfaces situated on the four corners of the Bril- 
louin zone. #/# c2 = 0.86, T/T c = 0.05, # || (110) and 
fi = 2. Arrow corresponds to q = 0.05 when hp = 0.26. 
(b) Corresponding joint DOS Nj(q). Arrow denotes the best 
nesting vector Q in < q x ,q y < 1.0 and q z = 0.5, indicating 
the four maxima Q = (0.5 ± q, 0.5 ± q, 0.5) centered around 
(0.5, 0.5, 0.5). (c) Schematic phase diagram of the HL phase. 



in the vortex state increases towards the normal value 
at H C 2- Because of the Pauli effect, even near # C 2 the 
order parameter amplitude is still non- vanishing. Thus 
beyond a certain # the enhanced SW can exceed the 
normal value. 

It is contrasted with the case for the absence of the 
Pauli effect (fi = 0) shown in Fig. 2(b) where the order pa- 
rameter decreases continuously via a second order tran- 
sition. There, the SW never exceeds the normal value 
and the SW enhancement never occurs even approach- 
ing H C 2 . Thus the Pauli paramagnetic effect triggers the 
SDW instability by improving nesting condition. The 
SW enhancement occurs because under the in-plane field 
the QP diamagnetic motions are parallel to the fc z -axis, 
thus they are sensing the nodal lines running along it, 
giving rise to the singularities in the k-DOS as seen in 
Fig. 2(a). This one-dimensional QP motion along the 
nodal line never appears when #||(001) as seen below. 

In Fig. 2(c) we display the k-DOS for #||(001). The 
SW distribution is featureless due to the fact that the QP 
trajectories in this field orientation traverses the perpen- 
dicular nodal line, yielding weaken singularities in the 
k-DOS. There is no SW enhancement above the normal 
value for any values of H, implying that the SDW insta- 
bility is absent in this orientation. Thus by tilting away 
from H ||(110) towards (001) the spectral enhancement 
ceases to exist. According to our calculation, the crit- 
ical tilting angle 9 cr ~ 30° from the ab plane. Up to 
this angle the peak intensity of the k-DOS is maintained. 
According to Correa, et al. [2(| the HL phase disappears 
above 6 ~ 30°. 

In Fig. 3(a) we display the 3D views of the SW dis- 
tributions on the a- Fermi surfaces in CeCoIns. This 
Fermi surface is situated in the four corner of the Bril- 
louin zone. It is clear that the best nesting is expected 
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for Q = (q, q, 0.5) in reciprocal vector units, where q 
is evaluated geometrically as q — 1 — 2fcp as indicated 
by arrows. The k z component of Q comes from the 
warping of the a-Fermi surface along the k z direction. 
In fact, the joint density of states (JDOS) defined by 
Nj{q) = (iV(k, E = 0)N(q - k,E = 0)) k , is one of the 
indicators to check the degree of the nesting condition 
and whose maximum may signify the SDW instability. 
The JDOS is presented in Fig. 3(b). The optimal nest- 
ing vector appears at Q = (0.5 ± q, 0.5 ± q, 0.5) with 
q = 0.05 when we approximate the Fermi wave number as 
kp = 0.26 of the a-orbit at the k z — plane according to 
the combined efforts by the dHvA experiment and band 
calculation [2 5]. It is not apparent whether the SDW is 
described by the double Q or the single Q. Theoretically 
those are equally possible. Experimentally it is desirable 
to determine it. In particular, for i?||(100) those pairs 
of the nesting vectors are equivalent by symmetry, lead- 
ing to either double Q structure or single Q structure 
with two domains. Yet, the existing experiment only 
observes one of the pair Q = (0.5 — q, 0.5 — q, 0.5) and 
Q = (0.5 + q,0.5 + (?,0.5). 

An SDW instability with the nesting vector Q could 
occur beyond a certain high field Hq{T) and below i? c2 
(see Fig. 3(c) for schematic phase diagram). As H in- 
creases towards H C 2 , the S W enhancement by vortices be- 
comes larger only along the nodal direction and provides 
the best SDW nesting condition. It occurs through the 
repulsive interaction U between those induced QPs. The 
Stoner instability condition; Ux(Q) > 1 with x(Q) static 
susceptibility of Q component is fulfilled. Note that 
x(Q = 0) = n%No. Since the observed wave length of the 
SDW modulation is an order of ~ 5nm and much shorter 
than £ ~ 30nm, there is still a possibility for FFLO to 
occur as advocated by several authors 1(J 14 [because the 
present SDW polarized along the c-axis 2l|, |22| does not 
liberate the penalty due to the Zeeman effect longitudi- 
nal to the in-plane fields. The in-plane anisotropy of the 
transition line Hq{T) may not be large because the to- 
tal DOSs for two directions (100) and (110) differ only 
by at most 0.4% 8]. As increasing T under a fixed H, 
the peak value of the SW enhancement N{k,E — 0) de- 
creases because of thermal broadening of the singulari- 
ties of k-DOS. Thus dH Q (T)/dT > 0, coinciding with 
the observation [15]. Likewise impurities easily kill the 
singularities, thus doping experiment can be understood 
where the HL p hase area diminishes upon small Cd- and 
Hg-dopings|27|. As shown above, the tilting field towards 
the c-axis ceases to induce the SW enhancement above 
the normal value. This is supported by the recent neu- 
tron experiment [28] and by Correa, et al.[26\. Therefore 
the HL phase in the in-plane field is not connected to the 
HL phase in the c-axis field, implying that the latter can- 
not be an SDW instability, but may be genuine FFLO. 
Those are logical conclusions and predictions based on 
our microscopic calculations. 



In summary, by solving the microscopic Eilenberger 
equations self-consistently with the d x 2_ y 2 pairing state 
and strong Pauli paramagnetic effect, we obtain the de- 
tailed information on the quasiparticle structures in both 
real and reciprocal spaces for vortex lattice states. This 
complemental information allows us to draw a picture 
that for the in-plane fields the spectral weight is enhanced 
by vortices for the nodal direction in k-space exceeded 
above the normal value, and thus signals an SDW insta- 
bility whose ordering vector directed towards the nodal 
direction. This kind of the coexistence between SDW and 
SC with vortices is a novel form confined exclusively in- 
side SC (see Fig. 3(c)), which is beyond known coexistence 
scheme where two orderings compete each other to try to 
open their own energy gaps on the Fermi surfacefi^]. The 
proposed new SDW mechanism may apply other heavy 
Fermion superconductors, such as Ce9PdIn s (30|. 
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